Model validation using mutated training labels: An exploratory study
نویسندگان
چکیده
We introduce an exploratory study on Mutation Validation (MV), a model validation method using mutated training labels for supervised learning. MV mutates data labels, retrains the against data, and then uses metamorphic relation that captures consequent performance changes to assess fit. It does not use set or test set. The intuition underpinning is overfitting models tend fit noise in data. aim replace out-of-sample validation. Instead, we provide first possibility of as complement explore 8 different learning algorithms, 18 datasets, 5 types hyperparameter tuning tasks. Our results demonstrate complements well cross-validation accuracy selection deserves more attention from developers when simplicity, sustainaiblity, security (e.g., defending attack), interpretability built are required.
منابع مشابه
Training End Users: An Exploratory Study
This article presents and empirically evaluates a conceptual mode/of how training can impact the acceptance of information systems within the organization. Specifically, the training of end users is explored via an extensive field study of 1 O0 middleand upper-level managers from 20 companies. The results indicate that (1) a positive relationship exists between the computer-related training an ...
متن کاملcost benefits of rehabilitation after acute coronary syndrome in iran; using an epidemiological model
چکیده ندارد.
an exploratory study of differential item functioning (dif) in efl reading comprehension
بررسی دلایل عملکرد متفاوت سوالات آزمون درک مطلب به زبان خارجی تاریخچه ی تحقیق درباره ی منابع عملکرد مختلف سوالات (دیف) در آزمون درک مطلب پر است از مجموعه ای از متغیرهای فرضیه ای که چند مورد از مهمترین آنها عبارتند از: جنسیت، آشنایی با موضوع متن، علاقه به موضوع یا محتوای متن، حدس زدن، و عوامل بافت اجتماعی (پی 2004؛ زومبو و گلین 2005). مطالعه حاضر با استناد به فلسفه ی انکارپذیری پوپر عوامل ذکر...
15 صفحه اولAn Exploratory Study of Intensive Neurofeedback Training for Schizophrenia
Schizophrenia is a chronic and devastating brain disorder with ongoing cognitive, behavioral, and emotional deteriorated functions. Neurofeedback training, which enables the individuals to regulate their brain activity using a real-time feedback loop, is increasingly investigated as a potential alternative intervention for schizophrenia. This study aimed to explore the effect of short but inten...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2023
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2023.02.042